Smooth Renyi Entropies and the Quantum Information Spectrum 
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Many of the traditional results in information theory, such as the channel coding theorem or the 
source coding theorem, are restricted to scenarios where the underlying resources are independent 
and identically distributed (i.i.d.) over a large number of uses. To overcome this limitation, two 
different techniques, the information spectrum method and the smooth entropy framework, have been 
developed independently. They are based on new entropy measures, called spectral entropy rates 
and smooth entropies, respectively, that generalize Shannon entropy (in the classical case) and von 
Neumann entropy (in the more general quantum case). Here, we show that the two techniques are 
closely related. More precisely, the spectral entropy rate can be seen as the asymptotic limit of the 
smooth entropy. Our results apply to the quantum setting and thus include the classical setting as 
a special case. 



INTRODUCTION 

Traditional results in information theory, e.g., the 
noisy channel coding theorem or the source coding (or 
data compression) theorem, typically rely on the as- 
sumption that underlying resources, e.g., information 
sources and communication channels, are "memoryless" . 
A memoryless information source is one which emits sig- 
nals that are independent of each other. Similarly, a 
channel is said to be memoryless if the noise acting on 
successive inputs to the channel is uncorrelated. Such 
resources can be described by a sequence of identical and 
independently distributed (i.i.d.) random variables. 

In reality, however, this assumption cannot generally 
be justified. This is particularly problematic in cryp- 
tography, where the accurate modeling of the system is 
essential to derive any claim about its security. 

In the past decade, two approaches have been proposed 
independently to overcome this limitation. The infor- 
mation spectrum approach was introduced by Han and 
Verdii [ll|, [l^, [2^ in an attempt to generalize the noisy 
channel coding theorem. This approach yields a unifying 
mathematical framework for obtaining asymptotic rate 
formulae for many different operational schemes in infor- 
mation theory, such as data compression, data transmis- 
sion, and hypothesis testing. The power of this method 
lies in the fact that it does not rely on the specific nature 
of the sources or channels involved in the schemes. 

The main ingredients of this method are new entropy- 
type measures, called spectral entropy rates, which are 
defined asymptotically for sequences of probability dis- 
tributions. They can be seen as generalizations of the 
Shannon entropy, and also inherit many of its proper- 
ties, such as subadditivity, strong subadditivity, mono- 
tonicity, and Araki-Lieb inequalities. They also sat- 
isfy chain rule inequalities. Their main feature, how- 
ever, is that they characterize various other asymptotic 
information-theoretic quantities, e.g., the data compres- 
sion rate, without relying on the i.i.d. assumption. 



Subsequently, Hayashi, Nagaoka, and Ogawa have gen- 
eralized the information-spectrum method to quantum- 
mechanical settings. They have applied the method to 
study quantum hypothesis testing and quantum source 
coding [l^, [l^, as well as to determine general expres- 
sions for the optimal rate of entanglement concentration 
[3] and the classical capacity of quantum channels [l^]- 
The method has been further extended by Bowen and 
Datta and used to obtain general formulae for the 
optimal rates of various information-theoretic protocols, 
e.g., the dense coding capacity for a noiseless quantum 
channel, assisted by arbitrary shared entanglement 
and the entanglement cost for arbitrary sequences of pure 
Q and mixed Q states. Recently, Matsumoto flS*! has 
also employed the information spectrum method to ob- 
tain an alternative (but equivalent) expression for the 
entanglement cost for an arbitrary sequence of states. 

In a simultaneous but independent development, the 
necessity to generalize Shannon's theory became appar- 
ent in the context of cryptography. Roughly speaking, 
one of the main challenges in cryptography is that one 
needs to deal with an adversary who might pursue an 
arbitrary (and unknown) strategy. In particular, the ad- 
versary might introduce undesired correlations which, for 
instance, make it difficult to justify assumptions on the 
independence of noise in a communication channel. 

Bennett, Brassard, Crepeau, and Maurer [l[ were 
among the first to make this point explicit, arguing that 
the Shannon entropy is not an appropriate measure for 
the ignorance of an adversary about a (partially secret) 
key. They proposed an alternative measure based on the 
collision entropy (i.e., Renyi entropy of order 2) and 
a notion called spoiling knowledge, which can be seen as a 
predecessor of smooth entropies. This approach has been 
further investigated by Cachin Q, who also found con- 
nections to other entropy measures, in particular Renyi 
entropies of arbitrary order. 

Motivated by the work of Bennett et al. and Cachin, 
smooth Renyi entropies have been introduced by Ren- 
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ner et al., first for the purely classical case (in 12211) and 
later for the more general quantum regime (in [20|,|2l|). 
In contrast to the spectral entropy rates, smooth Renyi 
entropies are defined for single distributions (rather 
than sequences of distributions). Because of their non- 
asymptotic nature, they depend on an additional param- 
eter e, called smoothness. 

Similarly to the spectral entropy rates, it has been 
shown that smooth entropies have many properties in 
common with Shannon and von Neumann entropy (for 
example, there is a chain rule, and strong subadditivity 
holds) [i^, [S^. Furthermore, they allow for a quantita- 
tive analysis of a broad variety of information-theoretic 
tasks — but in contrast to Shannon entropy, neither the 
i.i.d. assumption nor asymptotics are needed. For exam- 
ple, in the classical regime, it is possible to give a fully 
general formula for the number of classical bits that can 
be transmitted reliably (up to some error e) in one (or 
finitely many) uses of a classical channel 25|. In the 



tral projections {A < 0},{A > 0} and {A < 0}. For 
two operators A and B, we can then define {A > B} as 
{A — B > 0}. The following key lemmas are useful. For 
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quantum regime, they proved very useful in the context 
of randomness extraction 2^, 2ll, which, in turn, is used 
for cryptographic applicationsjl, 0, [13, 27 1 . In particu- 
lar, they are employed for the study of real-world imple- 
mentations of cryptographic schemes, where the available 
resources (e.g., the computational power or the memory 
size) are finite i26-] . 

Our aim in this paper is to find connections between 
the two different approaches described above, by explor- 
ing the relationships between spectral entropy rates and 
smooth entropies. We do this in two steps. First, we 
consider the special case where the entropies are not con- 
ditioned on an additional system, in the following called 
the non- conditional case. Then, in a second step, we con- 
sider the general conditional case where the entropies are 
conditioned on an extra system. 



DEFINITIONS OF SMOOTH ENTROPY AND 
SPECTRAL ENTROPY RATES 

Mathematical Preliminaries 

Let BCH) denote the algebra of linear operators acting 
on a finite-dimensional Hilbert space Ti.. The von Neu- 
mann entropy of a state p, i.e., a positive operator of unit 
trace in B{H), is given by S{p) — — Trplogp. Through- 
out this paper, we take the logarithm to base 2 and all 
Hilbert spaces considered are finite-dimensional. 

The quantum information spectrum approach requires 
the extensive use of spectral projections. Any self- 
adjoint operator A acting on a finite-dimensional Hilbert 
space may be written in its spectral decomposition A — 
^jAi|«)(i|. We define the positive spectral projection 
on A as {A > 0} := X]a >o projector onto 

the eigenspace of A corresponding to positive eigenval- 
ues. Corresponding definitions apply for the other spec- 



a proof of Lemma [T] see 

Lemma 1 For self-adjoint operators A, B and any pos- 
itive operator < P < I the inequality we have 

Ti[P{A~B)] < Tt[{A> B}{A- B)] (1) 
Tr[P{A-B)] > Tt[{A< B}{A- B)]. (2) 

Identical conditions hold for strict inequalities in the 
spectral projections {A < B} and {A > B}. 

Lemma 2 Given a state pn and a self-adjoint operator 
LOn, for any real 7 we have 

Tr[{p„>2-"Tc^„V„] <2^\ 

Proof Note that 

Tr[{p„ > 2-"Tc^„}(p„ - 2-"^c^„)] > 

Hence, 

2-"^Tr[{p„>2-"'^c^„}c^„] < Tr[{p„>2-"VJp„] 

< Trp„ = l (3) 

Therefore, 

Tr[{p„>2-"^c^„}c^„] <2"^. 



The trace distance between two operators A and B is 
given by 

\\A-B\\i := Tr[{A > B}{A-B)] -Tt[{A < B}{A-B)] 

(4) 

The fidelity of states p and p' is defined to be 



FiP,p') — Tr\/ pip' pi. 

The trace distance between two states p and p' is related 
to the fidelity F{p,p') as follows (see (9.110) of [13): 



^\\p--p\\i<V^^Fip,pr < v/2(l-F(p,p')) • (5) 
We also use the following simple corollary of Lemma [T] 

Corollary 1 For self-adjoint operators A, B and any 
positive operator < P < I , the inequality 

\\A^B\\,<e, 

for any £ > 0, implies that 

Tt[P{A~- B)] < e. 

We also use the "gentle measurement" lemma [l^ ll^ ■ 

Lemma 3 For a state p and operator < A < /, i/ 
Tr(pA) > 1 - (5, then 

||p-x/ApVA||i < 2VS. 

The same holds if p is only a subnormalized density op- 
erator. 
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Definition of spectral divergence rates 

In the quantum information spectrum approach one 
defines spectral divergence rates, defined below, which 
can be viewed as generalizations of the quantum relative 
entropy. 

Definition 1 Given a sequence of states p — {pn}'^=i 
and a sequence of positive operators u) = {^^^nl^i, the 
quantum spectral sup- (inf-) divergence rates are defined in 
terms of the difference operators n„(7) = Pn — '^^'^ujn o,s 

D{-p\\Q) := inf {7 : limsupTr[{n„(7) > 0}n„(7)] = o| 

(6) 

D{p\\^) ■■= sup (7 : liminf Tr[{n„(7) > 0}n„(7)] = l| 

(7) 

respectively. 

Although the use of sequences of states allows for im- 
mense freedom in choosing them, there remain a number 
of basic properties of the quantum spectral divergence 
rates that hold for all sequences. These are stated and 
proved in In the i.i.d. case the sequence is generated 
from product states p = which is used to re- 

late the spectral entropy rates for the sequence p to the 
entropy of a single state g. 

Note that the above definitions of the spectral diver- 
gence rates differ slig htly from those originally given in 
(38) and (39) of [l3|. However, they are equivalent, as 
stated in the following two propositions (proved in 
The proofs have been included in the Appendix for com- 
pleteness. 

Proposition 1 The spectral sup- divergence rate D(p\\u;) 
is equal to 

V{p\\cu) = inf \a : limsupTr[{p„ > e""w„}p„] = o| 

(8) 

which is the previously used definition of the spectral sup- 
divergence rate. Hence the two definitions are equivalent. 

Proposition 2 The spectral inf- divergence rate DipWia) 
is equivalent to 

VipWu) = sup (a : liminf Tr[{p„ > e""w„}p„] = l| 

(9) 

which is the previously used definition of the spectral inf- 
divergence rate. 

Despite these equivalences, it is useful to use the defi- 
nitions (O and ([7]) for the divergence rates as they allow 
the application of Lemmas [T] and [2] in deriving various 
properties of these rates. 



The spectral generalizations of the von Neumann en- 
tropy, the conditional entropy and the mutual informa- 
tion can all be expressed as spectral divergence rates with 
appropriate substitutions for the sequence of operators 

Definition of spectral entropy rates 

Consider a sequence of Hilbert spaces {H„}^i, with 
Tin = H®". For any sequence of states p — {pn}'^=ii 
with Pn being a density matrix acting in the Hilbert space 
TLm the sup- and inf- spectral entropy rates are defined 
as follows: 

S{p) = inf (7 : liminf Tr[{p„ > 2-"^J„}p„] = l| (10) 
Sip) = sup (7 : limsupTr[{p„ > 2-"^/„}p„] = o|. 

(11) 

Here /„ denotes the identity operator acting in 7i„. 
These are obtainable from the spectral divergence rates 
as follows [see 

Sip) = -mm ; Sip) = ~Dip\\i), (12) 

where / = {/„}?Li is a sequence of identity operators. 

It is known [3[ that the spectral entropy rates of p are 
related to the von Neumann entropies of the states p„ as 
follows: 

Sip) < liminf -S'(p„) < limsup -^(pn) < Sip). (13) 

n^oo n n— ►00 ri 

Moreover for a sequence of states p = 

Sip) - hm -Sipn) = Sip). (14) 

n — *oo n 

For sequences of bipartite states p = {Pn^}^^i, with 
e B((Ha«)Hb)®"), the conditional spectral en- 
tropy rates are defined as follows: 

SiA\B) := -^(p^^|/^®p^); (15) 
SiA\B) := -;D(p^^|/^®p^). (16) 

In the above, P = {/^f and p^^ ^ {p^}^^„ with /,f 
being the identity operator acting in in 7i^" and p^ — 
TiBPn^, the partial trace being taken on the Hilbert 
space Hg . 

Definition of min- and max-entropies 

We start with the definition of non-smooth min- and 
max-entropies. 
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Definition 2 ([20|) The min- and max-entropies of a 
bipartite state pab relative to a state as are defined by 

Hnun{PAB\o-B) ■= - logmm{A : PAB < A • /a (X) pb} 

and 

-ffmax(pAslo-B) := log Tr(7rAB (/yl X" CTs)) , 

where t^ab denotes the projector onto the support of pab ■ 

In the special case where the system B is trivial 
(i.e., 1-dimensional), we simply write -ffmin(/5A) and 
Hmayi{pA)- Thcsc entiopics then correspond to the usual 
non- conditional Renyi entropies of order infinity and 
zero, 

HminiPA) ^ Hoo{pa) = - log 1 1 1 1 oo 

Hma^PA) = Ho{pa) = logrank(p^) , 
where || • ||oo denotes the ioo-norm. 

Definition of smooth min- and max-entropies 

Smooth min- and max-entropies are generalizations 
of the above entropy measures, involving an additional 
smoothness parameter e > 0. For e = 0, they reduce to 
the non-smooth quantities. 



Definition 3 ([2Cr]) For any £ > 0, the e-smooth min- 
and max-entropies of a bipartite state pab relative to a 
state cfb are defined by 

H'Lin{PAB\<yB) ■= sup Hnun{p\crB) 

peB' 



H^^a^ipAB^B) := inf i?max(p|crs 

peB^ 



where B'^{p) {p > : Hp — 



<£,Tr(p) <Tr(p)}. 

In the following, we will focus on the smooth min- and 
max-entropies for the case where ub = Pb- Note that the 
quantities H^^^{pab\B) := maxo-^ -ffniinlpAsks) and 
H^a.JpAB\B) := min^^ H^^^{pAB\crB) defined in ^ 
are not studied in this paper. 

RELATION BETWEEN NON-CONDITIONAL 
ENTROPIES 

Relation between S_{p) and H^i^{p) 

Theorem 1 Given a sequence of states p = {pn}'^=ij 
where p„ € BiTLn), with TLn — 7i®", the inf- spectral en- 
tropy rate S_(j}) is related to the smooth min- entropy as 
follows: 



S_{p) = limliminf-iJ^i„(/9„) 

£—►0 ra— KX) n 



(17) 



Proof For any constant 7 > 0, let us define projection 
operators 



QZ := {p„ < 2-"^/„} 



(18) 



and 



P,T /„ -QZ = {p„ > 2-"^/„}. (19) 
In terms of these projections, we can write 

S{p) = sup (7 : Hm sup Tr [P^Pn] = o| , (20) 

or alternatively as 

Sip) = sup (7 : liminf Tr[Q>„] = l|, (21) 

since each p„ in the sequence p is a state (i.e., Trp„ = 1). 
From Proposition [2] and (fT2|l of S_{p) it follows that the 
latter is cquivalently given by the expression 

S{p) = sup {7 : limsupTr[P^(p„ - 2'"^In)] = o|, 

(22) 

From (pTjl it follows that, for any 7 < S_{p) and any 
6 > 0, for n large enough, 

Tt[QZp^] > 1 - S. (23) 

For any given a > 0, let 7 := 5(/o) — a, and let 

pZ QZPnQZ (24) 

Then using (j23p and Lemma [3] we infer that, for n large 
enough, 



\Pn - P 



pZ\\i<2V~s. 



(25) 



In other words, for n large enough, pZ G B^[pn) with 
We first prove the upper bound 



S_{p) < limliminf ii7^i„(p„) 

E— ►0 n— ►oo n 



(26) 



For n large enough. 



HL\n{Pn) = sup HnuniPn) 

p„eB-{p„) 

> H^inipZ) = -logKlloo 

> n-f = n{Sip) - a) (27) 

The last line follows from the inequality pZ < 2~"'''/„, 
and since a is arbitrary, we obtain the desired bound 



(28) 



We next prove the converse, i.e., 

S_{p) > limliminf ii7fj,i„(p„) 

£—►0 n—foo 11 
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Consider an operator p^^ € B'^{pn) for which 

-logllp^lloo = sup [-log||p„||oo]. (29) 

We shall also make use of a quantity T(S), defined 
for any sequence of positive operators cD — {tOn^'^^i as 
follows: 

T(w) = supja : lim sup Tr [{u;„ > 2-""/„}n^] = o|, 

(30) 

where 11" := (cj„ — 2 "°'In)- Note that T(S) reduces to 
the inf-spectral entropy rate S(u}) given by (l22|) . if £ is a 
sequence of states. 

By the definition of the smooth min-entropy, (|28p then 
follows from Lemma |4] below. 



Lemma 4 For any sequence of states p — {pn})?Li; '"^'^ 
an?/ e > 0, there exists an uq G N, such that for all 
n > riQ 



1 



s{p) >-[^iog\\rjoo], 



(31) 



The third line in (1361) is obtained by using the bound 

which follows from Corollary [1] since pf^ e B^{pn). 

To arrive at the last line of ([36]) we use Lemma [1] and 
the fact that TrP^' < 2"'^, which follows from Lemma H 

Let us choose 7 — a — (5/2, for an arbitrary 5 > 0, with 
a = T(p^) — (5/2. Then both the first and second terms 
on the r.h.s. of goes to zero as n ^ 00. Therefore, 
for n large enough and any i5 > 0, in the limit e — > 0, we 
must have that 



Tr(P„>„) < 5 , 



(37) 



which in turn implies that 7 < S_{p). 

From the choice of the parameters a and 7 it follows 
that 



lim r {p')-S <S{p). 



(38) 



But since S is arbitrary, we obtain the inequality ([55)) . 



with p^ defined by h29\) . 

Proof We prove this in two steps. We first prove that 
for any e > and n large enough, 



T(p^)>--log||p^Jloo, 
n 

where := {Pn}'n'=i- We then prove that 

limT(p-)<5(p) 

£—+0 



(32) 



(33) 



For any arbitrary 77 > 0, let (3; be defined through the 
relation 



II _ n-n(Q+r() 
-'niloo — ^ 



(34) 



This implies the operator inequality, p^— 2~"*^"+''^/„ < 0, 
and hence p^ < 2~""/„. 
Hence, 

TV[{p^ > 2-""/„}(p^, - 2-""/„)] = 0, (35) 

Using this, and the definition of T(p^), we infer that 
a < T(p^). Then, using ([M|) we obtain the bound 

-ilog||p^Jloo-r7<T(p^), 

which in turn yields (I32p . since rj is arbitrary. 
To prove ([55]) note that 



< Tr(P„>„) 

= TliP.2rn)+Tv[P2ipn-rn)] 

< Tr[F„^(pf, - 2-""/„)] + 2-""TrP„^ + s 

< Tr[{pf, > 2-"-/„}(p^„ - 2-""/„)] + 2-"("-^) + e. 

(36) 



Relation between S{p) and H^^^^^{p) 

Theorem 2 Given a sequence of states p = {Pn\'^=ij 
where Pn G B{Hn), with 7i„ — Ti.®"' , the sup-spectral 
entropy rate S{p) is related to the smooth max-entropy 
as follows: 

S'(p) = lim lim sup- i7^ja^(p„) (39) 

^ n — >oo n 

Proof By definition, the sup-spectral entropy rate for the 
given sequence of states is 

S{p) = inf {7 : lim inf Tr [P^Pn] = 1 } , (40) 

where P^ is the projection operator defined by ([TO]) . 

From ([^0)1 it follows that, for any 7 > S{p) and any 
(5 > 0, for n large enough 

Tr[P>„] > 1~(5. (41) 

For any given a > 0, choose 7 = S'(p) + a, and let 

p;^ := P,Tp„P„^ (42) 

Then using (|4ip and Lemma [3|wc infer that, for n large 
enough, 

||p„-ftll|i<2%/^. (43) 

and hence p^ e B^{pn) with e = 2\/^. 
We first prove the bound 



Um lim sup -H^ax(P«) < S{p) (44) 
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For n large enough, 

-f^max(Pn) = _ -ffmax(P„) 

= log rank (p;^) (45) 

From the definition (|42)l of it follows that rank < 
TrPT-. Hence, 

HL^M < logTrPJ 

< 717 = S-O) + a, (46) 

where once again we use the bound TrP^ < 2"^. The 
last line of (|^ yields the desired bound ([ii]) since a is 
arbitrary. 

To complete the proof of Theorem [2] we assume that 

lim lim sup -i/^,ax(P«) < S{p) (47) 

and show that this leads to a contradiction. 
Let (T„.e be the operator for which 

i?max(0'„,e) := iuf i?max(p„)- (48) 

p„es^(p„) 

Hence, H^^^{pn) = log rank cr„_e, and the assumption 
(|47|) is equivalent to the following assumption: 

lim lim — log rank ^ < S{p). (49) 

Since ct„_£ G B'^{pn), Tr(T„.e > 1 — e. Let crJJ^ denote the 
projection onto the support of (7n,e- Then 

= Tr[(/9„ - (T„,e)CT" „] + Tro-„,e 

> Tr[{p„ < (Tn,s}{Pn - O-n.e)] +1- S 

> -e + 1 - e = 1 - 2e. (50) 

The inequality in the third line follows from Lemma [1] 
We arrive at the last inequality in (|50p by using the bound 

Tr[{p„ < cr„,e}(p„ - 0-n,e)] > S, 

which arises from the fact that cr„.e G B'{pn). 

Note, however, that for n large enough, (|5D|) leads to 
a contradiction, in the limit e ^ 0. This is because, for 
any real number R < S{p) and any projection 7r„, with 
Tr7r„ = 2"^, for n large enough, we have 

Tr(7r„p„) < 1 - Co, (51) 

for some constant cq > 0. The inequality ((5T|) can be 
proved as follows: 

Tr(7r„p„) = Tr[^„(p„~2-"'3/„)] +2-"''Tr7r„ 
< Tr[{p„ > 2-"''/„}(p„ - 2-"^/„)] 

(52) 



Choose S{p) > j3 > R. For such a choice, the second term 
on the right hand side of l|52p tends to zero asymptotically 
in n. However, the first term does not tend to 1 and we 
hence obtain the bound ([51]) . 



RELATION BETWEEN CONDITIONAL 
ENTROPIES 

Consider a sequence of bipartite states p"*^ = 
{Pn'^yn^i, with p^^ e 6((Ha ® Hb)»"). Let p^^ = 
{Pn^ln^i denote the corresponding sequence of reduced 
states. 

For the sequence p^^ , the sup-spectral conditional en- 
tropy rate S{A\B) and the inf-spectral conditional en- 
tropy rate S_{A\B), defined respectively by and 
can be expressed as follows: 

S{A\B) = inf|7:liminfTr[P,7p;t^] =l}, (53) 

SiA\B) - sup|7:limsupTr[P„V;t^] =0}, (54) 

where 

P,T:={pr >2-"^/^®p,f}. (55) 

Here denotes the identity operator in S(7i®"). 

We use the following key properties of H^^^^{pab\pb) 
given by Lemma [5] and Lemma [B] below. 

Lemma 5 Let pab and gb be density operators, let Aab 
be a positive operator, and let X such that 

PAB < ■lA®crB + Aab ■ 

Then H^-^^{pAB\<yB) > A for any e > ^8Tt{Aab)- 

Proof Define 

aAB := 2~^ ■ Ia^ctb 

Pab ■■= 2"^ ■Ia^(Jb+ Aab ■ 

and 

Tab ■■= o^abPab ■ 

Let I'l') — \'^)abr be a purification of pab and let j^*') :— 
Tab^IrI^) and p'^g := Tr^(|*'> (*'!)• 
Note that 

Pab = TabPabTab 
< TabPabTab 
^ aAB = 2"^ ■ Ia®(Jb , 

which implies i?min(p^Bl''^s) > A. It thus remains to be 
shown that 

Wpab-p'abWi < V8Tr(AAB) . (56) 



We first show that the Hermitian operator 



1 



Tab ■- 2^Tab + ^ab) ■ 



satisfies 



Tab < Iab 



(57) 



For any vector 



IAB, 



IT 



AB\ 



'\t\bTab\ 



{(t)\(3^^aABPAB\^) 

< {q^\p-iPABPAm ^ \\m' 

where the inequality follows from aAB < f^AB ■ Similarly, 



\tU 



\TabTIs\ 



<('^l 



_ II I J,\ Il2 



where the inequality follows from the fact that (3^^ < 
^AB 'which holds because the function t — t^^ is op- 
erator monotone on (0, oo) (see Proposition V.1.6 of [^). 
We conclude that for any vector |(/)), 



\\fABm<^\\TAB\'ti)+TU 



< ^\\Tab\ 



+ ^\\TU 



< 



which implies (j57p . 

We now determine the overlap between |^) and j'l''), 

= mTAB^lB]"^) 

^ Tril'f) {^\Tab ® Ir) = T^YipABTAB) ■ 
Because pab has trace one, we have 

1- <l-'fi{-^\-^') ^TT{pAB{lAB~fAB)) 

< Tr{f3AB{lAB-fAB)) 

= TT{(3AB)-Tr{aisl3is) 

< Ti{(3ab) - Tr(a^s) = Tr(AAB) • 

Here, the second inequality follows from the fact that, 
because of (|57l) , the operator Iab — Tab is positive and 
PAB < I3ab- The last inequality holds because a^g < 

f^ABi which is a consequence of the operator monotonicity 
of the square root (Proposition V.1.8 of 0]). 

Using ([5]) and the fact that the fidelity between two 
pure states is given by their overlap, we find 



< 2v^2Tr(AAB) < e . 

Inequality ([56| then follows because the trace distance 
can only decrease when taking the partial trace. H 



Lemma 6 Let pab o,nd as be density operators. Then 

H'r,in{PAB\<JB) > A 

for any A G M and 



e = ^8Tt{{pab > 2-^ • I a ® ^bIpab) ■ 

Proof Let Aj^^ and A^^ be mutually orthogonal posi- 
tive operators such that 

- A;^^ = PAB - -Ia^cfb ■ 

Furthermore, let Pab be the projector onto the support 
of A+^, i.e., 

Pab = {pAB > ■ Ia ® ctb} ■ 
We then have 

PabPabPab = Pab{2-^ ■lA<E)aB + A+^ - A^s)Pab 
>A1 



^AB 



and, hence, 



/8Tr(A+^) < ^8Tt{PabPab) = e . 
The assertion now follows from Lemma [5] because 
PAB < ■Ia®(tb + A\g . 



In the following sections we state and prove the rela- 
tions between the conditional spectral entropy rates and 
the smooth conditional max- and min-entropy. 



Relation between S{A\B) and -ffmax(p.4s|/9s) 

Theorem 3 Given a sequence of bipartite states = 
{Pn^'yn^i, where p^^ £ BUHa ® Hb)^"), the sup- 
spectral conditional entropy rate S{A\B), defined by i53\) . 
satisfies 

S{A\B) - \imlunsnp^H-^,^{p^^\p^), (58) 

where HmaxiPn^lPn) the smooth max-entropy of the 
state p^^ of the sequence, conditional on the correspond- 
ing reduced state p^ . 

Proof Fromjhe definition ^ oi^{A\B) it follows that 
for any 7 > S{A\B) and any (5 > 0, for n large enough 



where P,7 is defined by ([55)1 . 



(59) 
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For any given a > 0, choose 7 = S(A\B) + a, and let 

p^!", p^pt^'p: (60) 

Then using (j59p and Lemma [3] we infer that, for n large 
enough, p^^ e B^^p^^) with e^2\/6. Let t:^^ denote 
the projection onto the support of p^^. 
We first prove bound 

lim limsuplH,^,,(p„) < S{A\B). (61) 

For n large enough, 

Hl.Api''\Pn) ■■= inf i?„,ax(pnpf) 

< ffmax(p;^,^|p,f) 

= logTr((/,f ®pfX^) 

< logTr((/;f®p^)P„^) 

< n7 (62) 

The last inequality in ([62]) follows from Lemma[2l Hence, 
for n large enough, 

-Hl^,{pi^\p^)<^^S{A\B)+a, (63) 
n 

and since a is arbitrary, we obtain the desired bound 

m- 

To complete the proof of Theorem [3l we assume that 
lim limsupii?;;,,,(p;t^|pf ) < S{A\B), (64) 

and prove that this leads to a contradiction. Let (T,f f be 
the operator for which 

i?„.a.«f |P^) = mf i7.na.(p^^|pf ). (65) 

Hence, 

J^maAPn \Pn ) = J^ms^Ac^n.E \Pn ) 

= logTr((/;f ®pf)^;^^f), (66) 

where Tr^f is the projection onto the support of cr^f ■ 

Hence, the assumption ([64)1 is equivalent to the follow- 
ing assumption: 

hm hm sup - log Tr [<f (/;f ® )] < ^(A|B). (67) 

Note that 

Tr«fpr) 
= Tr[((pr--,f.?)+<f)<f] 
= Tr[(pr--„^.?)<f]+Tra„^.? 

> Tr[{pr < - <?)] + Tr[<f ] 

> -e + 1 - £ = 1 - 2e. (68) 



We arrive at the second last line of (|68|) using Lemma 
[1] The last line of (|68p is obtained analogously to (|50p . 
since <f e SnPn"")- 

Note, however, that (|68p leads to a contradiction. This 
can be seen as follows: Let i? be a real number satisfying 

Tr[<f(/„^®pf)]=2"^. 

It follows from the assumption (pT)) that, for e small 
enough, i? < S{A\B). Note that 



Tr(<^pr) 
= Tr[<f(pr-2~"^4^®pf)] 

+2-"^Tr[<f(/,f ®pf)] 
< Tr[{pr > 2-"^/^ ® }(pr - 2-"^/^ ® p^)] 

_|_2-n(7--R) 

(69) 

Choose S{A\B) > ■y > R. For such a choice, the second 
term on the right hand side of (j69p tends to zero asymp- 
totically in n. However, the first term does not tend to 
1 and we hence obtain the bound 



Tr(<t'pr)<l-co, 



(70) 



for some constant cq > 0. This contradicts ([SS]) in the 
limit e ^ 0. ■ 



Relation between S(^|-B) andH^-^^^JpABlpB) 

Theorem 4 Given a sequence of bipartite states p^^ = 
{Pn^}n=i, where p^^ e B{{Ha <^ Hs)®"), the inf- 
spectral conditional entropy rate S_{A\B) is related to the 
smooth conditional min-entropy as follows: 

S{A\B) = hm liminf -i?f„i„(p;^^|pf ) (71) 

Proof 

We first prove the bound 

S{A\B) > hm liminf -H^^^.M^'lPn) (72) 

Let CT,;^f be the operator for which 

HnW^:^!^\Pn) = max i7,,i„(p^^ |p,f ). (73) 

Let us define 
T{A\B) 

:= sup (a : limsupTr[{<f > 2"""/;^ ® pf }H^] - o|, 

(74) 



where H^ := a:^^ - 2-""/,f (g) p^. 



According to Definition [3] of the conditional smooth 
min-entropy, that to prove (I72p . it suffices to prove the 
following lemma: 
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Lemma 7 For any sequence of bipartite states = 
{Pn^}^=i, and any e > 0, there exists an uq G N, such 
that for all n > Uq 

S{A\B) > -- log[{min{A : a^^ < A/f (g> }}] , (75) 

with CT^^.f defined by [7^. 

Proof We prove this lemma in two steps. We first prove 
that for any e > and n large enough, 



Tf{A\B) > ~- log[min{A : <f < A/;f ® p^}] . (76) 
We then prove that 

SiA\B) > limT^(A|B). 



£-+0" 



(77) 



Proof of f75| j; For any arbitrary r] > 0, let a be defined 
through the relation 



Hence, 



1 



iin{A : <f < XI^ ® } = 2-"("+"). (78) 



log[min{A : <f < XI^ ® }] = a + rj (79) 



Note that (HSl) impUes that a^^^ < 2-"("+'')(/;;' (g) p^), 
and hence (a^^.f - 2-"^"+'')/;^ (g) p^) < 0. This in turn 
implies that {a^'^ - 2"""/;;^ ) < and hence 

Tr[{<f > 2-""/;f ® }«f - 2-""/;f ® )] = 0. 

(80) 

It then follows from the definition ^ of T^(A|B) that 
a < T%A\B). Hence, using we get 

-llog[min{A : a^^ < A/,f ®pf < r{A\B), (81) 

which in turn yields (|76p . since 77 is arbitrary. 

Proof of (7^: Defining {p^^ > 2-"^/;^ ^ pf }, 

note that 

= Tr[P„V,f]+Tr[P„^(pr"a;^.?)] 

< Tr[P„^(a;^,f-2-""(/;f®pf)] 
+2-""Tr[P„^(/;f®pf)]+e 

< Tr[{<f > 2-""/,f ® pf }«f - 2-""(/;f ® pf )] 

(82) 



+2- 



-71(0 — 7) 



In the above we have made use of Lemma [1] Lemma [5] 
and Corollary [TJ 

Let us choose 7 = a — (5/2, for an arbitrary S > 0, with 
a = {A\B) — S /2. Then both the first and second terms 
on the right hand side of ([5^ goes to zero as n ^ 00. 



Therefore, for n large enough and any 6 > 0, in the limit 
e — > 0, we must have that 

Tr(P,>r)<<5', (83) 

which in turn implies that 7 < S_{A\B). Hence, from the 
choice of the parameters a and 7 it follows that 

\imT'{A\B)~5<S{A\B), (84) 
£—♦0 

and since S is arbitrary, we obtain the inequality ()77|) . H 
We next prove the bound 

SiA\B) < lim hminf li7f„i„(p;t^|pf) (85) 

£—►0 n^oo n 

Proof of i85]): Let ^ > be arbitrary but fixed. Then by 
the definition of the inf-spectral conditional entropy rate 
there exists 7 g R such that 



7>S{A\B)-S 



(86) 



and 



limsupTr[{p;t^ > 2""^/^ ® pf }p;^^] = . (87) 

n — *oo 

In particular, for any e > there exists rip G N such that 
for all n > hq. 

Tr[{pr >2-"--/„^®p,f}pr] 

< Tr [{p^^ > 2-"^ . ® p^}p^^] < ^ . (88) 
Using Lemma [5] we then infer that for all n> uq 

HLiApt''\Pn) > "7 (89) 

and, hence 



liminflff,^i„(p;^^|pf)>7. 

n — ^00 TL 

Because this holds for any e > 0, we conclude 
1 



(90) 



lim liminf-H;^,i„(pr |P^) > 7 > ^(^|P) ~ S . (91) 

£— *U n—*oo Ji 



The assertion (|85p then follows because this holds for any 

s>o. m 



CONCLUSIONS 

So far, the information spectrum approach and the 
smooth entropy framework have been applied within 
pretty different subfields of information theory In 
the quantum regime, spectral entropy rates have mostly 
been used to characterize information sources, commu- 
nication channels and entanglement manipulations. In 
contrast, smooth entropies proved useful in the context 
of randomness extraction and cryptography. We hope 
that our result bridges the gap between these two sub- 
fields. In fact, for the study of asymptotic settings where 
the underlying resources are available many times, both 
the information-spectrum approach and the smooth en- 
tropy framework can be used equivalently. 
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APPENDIX 



a = '^{p\\io) — (5, 7 = — '26, we have from Lemma 

HI 

1 Tr[{p„ > e""^„}p„] 

<Tr[{p„>e"^c^„}(p„-e"Tw„)] 
+ e"^Tr[{p„>e""a;„}a;„] 

< Tr[{p„ > e"^t^„}(p„ - e"Tw„)] + e""' (95) 

where Tr[{p„ > e""w„}w„] < e""" holds for any a. 
Thus hm„^cx) Tr[{/9„ > e^^WnKpn - e"^a;„)] = 1, where 
7 > D.ipW'-^), which is a contradiction. ■ 



In this Appendix we give the proofs of Proposition [T] 
and Proposition [51 

PROOF OF PROPOSITION 1 

Proof For any a = 'D{p\\uj) + 5, with 5 > 0, implies 
0= lim Tr[{p„>e""w„}p„] 

n^oo 

> hm Tr[{p„ > e""c^„}(p„ - e""c^„)] 

> (92) 

giving 'D{p\\llj) > D{p\\uj), as 6 is arbitrary. For the con- 
verse we assume that the inequality is strict, such that 
'D{p\\u}) = D(p\\uj) + 46 for some 6 > 0. Then choosing 
a — D{p\\uj) + 26, 7 — D{p\\uj) + 6, we have from Lemma 

m 

Tr[{p„ > e""c^„}p„] < Tr[{p„ > e"Tc^„}(p„ - e"Tcc>„)] 
-f e"^Tr[{p„>e""c^„K,] 
< Sn + e-"^ (93) 

where = Tr[{/9„ > e"^w„}(p„-e"^Lj„)] andTr[{p„ > 
e'^"u!n}uJn] < c""" holds for any a. As the right hand 
side goes to zero asymptotically and since a < D^pWuj) 
we have a contradiction. ■ 



PROOF OF PROPOSITION 2 

Proof For any a = D.{p\\^) — 6, with 6 > 0, implies 
1> lim Tr[{p„>e""L^„K] 
> hm Tr[{p„ > e""c^„}(p„ - e""c^„)] 

■n—*oo 

= 1 (94) 

giving ^{p\\uj) > D.{p\W), as 6 is arbitrary. For the con- 
verse we assume that the inequality is strict, such that 
'D{p\\llj) — D.{p\\^) + 4:6 for some 6 > 0. Then choosing 
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